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Abstract 

Background: Shared-decision-making about resuscitation goals of care for intensive care unit (ICU) patients 
depends on a basic understanding of cardiopulmonary resuscitation (CPR). Our objective was to develop and 
validate a survey to assess comprehension of CPR among ICU patients and surrogate decision-makers. 

Methods: We developed a 12-item verbally-administered survey incorporating input from patients, clinicians, and 
expert focus groups. 

Results: We administered the survey to 32 ICU patients and 37 surrogates, as well as to 20 resident physicians to 
test discriminative validity. Median (interquartile range) total knowledge scores were 7 (5-10) for patients, 9 (7-12) 
for surrogates, and 14.5 (14-15) for physicians (p <.001). Forty-four percent of patients and 24% of surrogates could 
not explain the purpose of CPR. Eighty-eight percent of patients and 73% of surrogates could not name chest 
compressions and breathing assistance as two components of CPR in the hospital. Forty-one percent of patients 
and 24% of surrogates could not name a single possible complication of CPR. Forty-three percent of participants 
could not specify that CPR would be performed with a full code order and 25% of participants could not specify 
that CPR would not be performed with a do-not-resuscitate order. Internal consistency (Cronbach's alpha = 0.97) 
and test-retest reliability (Pearson correlation = 0.96, p < .001) were high. 

Conclusions: This easily administered survey, developed to measure knowledge of CPR and resuscitation preference 
options among ICU patients and surrogates, showed strong face validity, content validity, internal consistency, 
test-retest reliability, and discriminative validity. A substantial proportion of ICU patients and surrogates decision-makers 
have poor knowledge of CPR and basic resuscitation options. 
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Background 

Health care providers should discuss cardiopulmonary 
resuscitation (CPR) preferences with patients who are at 
risk of requiring CPR, in order to ensure that this inter- 
vention is in accordance with the patient's goals of care 
[1,2]. Nevertheless, such code status discussions occur 
with varying frequency, even for hospitalized and critically 
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ill patients [3-6]. Discussions regarding resuscitation prefer- 
ences can be difficult and confusing for patients, surrogates, 
and providers [7]. While conversations about resuscitation 
preferences should optimally occur prior to the develop- 
ment of critical illness, this is often not the case and dis- 
cussions occur in the context of acute critical illness and 
emotional distress. In addition, discussions about CPR are 
often unnecessarily obscured by medical jargon and do 
not contain the elements suggested by professional soci- 
eties and bioethicists [8]. 
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Knowledge of CPR and resuscitation choices is one 
key component of shared medical decision making [9]. 
While previous survey instruments have been utilized 
to measure knowledge of CPR components and success 
rates [3,4,10-16], their measurement of resuscitation 
choices and other CPR-related terminology, as well as 
validation and testing in intensive care unit (ICU) pop- 
ulations, is limited. For this study our objectives were 
to: 1) Develop and validate a survey to measure patient 
and surrogate decision-maker understanding of resusci- 
tation terminology and resuscitation options, and 2) 
Use the validated survey to measure the understanding 
of resuscitation terminology and resuscitation options 
in a cohort of ICU patients and surrogates. We hypoth- 
esized that patients and surrogates would have limited 
knowledge of CPR and CPR choices in the hospital, and 
that surrogates' understanding would be comparatively 
better. 



Methods 

Survey development 

A list of possible survey items regarding CPR and resusci- 
tation preferences was generated from interviews with pa- 
tients, surrogates, internal medicine resident physicians, 
ICU nurses, ICU attending physicians, palliative care phy- 
sicians, patient education specialists, as well as a literature 
review of existing resuscitation surveys [3,4,10-16]. This 
comprehensive list was then refined based on item con- 
tent and usability by expert consensus of a group of five 
ICU physicians, five ICU nurses, and three patient educa- 
tion specialists. This group determined that, due to critical 
illness, ICU patients and their surrogates would best be 
served by a verbally administered questionnaire. The sur- 
vey instrument assessed knowledge of the possible com- 
ponents of CPR in the hospital, the definition of CPR 
related terms and acronyms, as well as the various resusci- 
tation preference options for hospitalized patients (see 
Figure 1). The survey assessed patients' core level of 
knowledge of CPR (such as "What is the purpose of CPR" 
and "What treatments are used in CPR?") as well as the 
meaning of commonly used medical terms (such as "What 
does intubation mean?"). The survey consisted of 12 
questions with one point being awarded for each correct 
response. Question four had a total of four possible cor- 
rect answers. Thus the score survey score ranged from 
0-15 points, with higher scores representing increased 
knowledge. 

Face and content validity 

Face validity (the extent to which the survey appeared to 
measure its intended domain) and content validity (the 
extent to which the survey measured all aspects of its 



intended domain) were assessed via two thirty minute 
focus group sessions with ICU physician and nurse partic- 
ipants. The focus groups assessed the items for accuracy, 
clarity, relevance, completeness, breadth, and usability in 
an ICU population. We then pilot tested this survey in a 
small group of ten ICU patients and ten surrogates, re- 
cording their answers and any misunderstandings about 
the questions. We then modified the survey questions 
based on this feedback. 



Discriminative validity 

Discriminative validity (the extent to which the survey 
distinguished between two groups of subjects who were 
expected to perform differently) was measured by com- 
paring the survey results of the patients and surrogate 
cohorts to a cohort of internal medicine resident physi- 
cians, who were expected to demonstrate an increased 
knowledge. 

Test-retest reliability 

Test-retest reliability (the extent to which survey results 
were similar under different conditions or periods of 
time) was measured by repeating the survey in patients 
and surrogates 24 hours after the initial survey. Phys- 
ician surveys were repeated two weeks apart. 

Study participants 

The revised survey (see Figure 1) was then verbally ad- 
ministered verbatim by a single survey administrator to 
patients and surrogates in one surgical ICU and one 
mixed medical/surgical ICU in a single medical center. 
The survey administrator was trained in survey admin- 
istration and result interpretation. The survey adminis- 
trator approached the medical team (physicians and 
nurses) of consecutive patients admitted to the ICUs in 
the previous 48 hours. If the medical team determined 
that patients were making their own medical decisions 
and were not delirious, then patients were approached 
to enroll in the study. Patient orientation to month, 
year, and place was then objectively verified and in- 
formed consent was obtained. If patients with decision 
making capacity were unavailable to participate (such as 
away at testing) on two occasions, then they were ex- 
cluded from the study. If patients were disoriented or 
were assessed not to be making their own medical deci- 
sions, then the patients' surrogate decision makers (as 
named by the medical team) were approached to enroll 
in the study. Excluded groups included minors, pris- 
oners, pregnant women, and non-English speakers. For 
the purpose of testing discriminative validity, the survey 
was also administered to 20 internal medicine resident 
physicians after informed consent was obtained. The 
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Scoring: Each box represents one point. 

1 : What do the letters "CPR" stand for? (1 point) 

□ Stated the phrase "cardiopulmonary resuscitation" or the word "resuscitation" 

2: CPR stands for cardiopulmonary resuscitation. What is the purpose of CPR? ( 1 point) 

□ Named or described: restart the heart or restart breathing or keep you alive or keep blood circulating 

3 : When would members of the medical team start performing CPR? (1 point) 

□ Named or described: heart stops or breathing stops or no pulse 

4: What treatments arc used in CPR? (prompt if needed: What do doctors do to patients during CPR?) (upto 4 points) 

□ Named or described: chest compressions or pushing up and down 

□ Named or described: any form of breathing assistance (mouth to mouth, bag breathing, breathing machine, or intubation) 

□ Named or described: defibrillation or shocking the heart 

□ Named or described: medications or intravenous fluids 

5 : What does intubation mean? ( 1 point) 

□ Described inserting a tube into the airway (windpipe, lungs, mouth, trachea, or throat) to help with breathing 

6: What does mechanical ventilation mean? (1 point) 

□ Named or described: machine to help with breathing 

7: What arc some possible complications of CPR? ( 1 point) 

□ Named at least one complication (fractured ribs, brain death, or organ failure, etc.) 

8: What do the letters "DNR" stand for? (1 point) 

□ Stated the phrase "do-not-resuscitate" 

9: What do the letters "DNI" stand for? (1 point) 

□ Stated the phrase "do-not-intubate" 

10: If the heart stops of a patient who has chosen Full Code, what is the response of the medical team? (1 point) 

□ Named or described: start CPR (resuscitation) or do everything to help the patient 

1 1 : If the heart stops of a patient who has chosen DNR. what is the response of the medical team? (1 point) 

□ Named or described: do not start CPR (resuscitation) or do nothing or let the patient die or make the patient comfortable 

12: What does the term "code status" mean? (1 point) 

□ Mentioned wish/prcfcrencc/dcsirc, etc. and need for resuscitation (CPR) 

TOTAL POINTS (OUT OF 15 POINTS TOTAL): 

Figure 1 CPR survey instrument (with criteria for receiving credit for a given response). 



Mayo Clinic Institutional Board of Review approved the 
study protocol. 

Statistical analysis 

Paired Student's t-tests, the Wilcoxon's rank-sum test, 
and the chi-square test were used as appropriate for uni- 
variate comparisons. Test-retest reliability was per- 
formed using a Pearson correlation for total knowledge 
scores. Internal consistency was measured using Cronbachs 
alpha. P values < 0.05 were considered statistically sig- 
nificant. Statistical analysis was performed with JMP 
(JMP, Version 9, SAS Institute Inc.). 

Results 

One hundred four ICU patients were approached for 
participation in the study, of which thirty two met exclu- 
sion criteria (Figure 2). In total, the survey was verbally 
administered to 32 patients and 37 surrogate decision 



members, as well as to 20 internal medicine residents 
test discriminative validity (Table 1). 

Survey results and discriminative validity 

Median (interquartile range) total knowledge scores were 
7 (5-10) out of 15 for patients, 9 (7-12) for surrogates, and 
14.5 (14-15) for physicians with a p value of <0.001, repre- 
senting excellent discriminative validity (Table 2). 

Fifty six percent of patients and 76% of surrogates 
could explain the purpose of CPR. Only 12% percent of 
patients and 27% of surrogates could name chest com- 
pressions and breathing assistance as components of 
CPR. Forty one percent of patients and 24% of surro- 
gates could not name a single possible complication of 
CPR. Similarly, 37% of patients and 49% of surrogates 
were unable to conclude that CPR would be performed 
if the patient chose to have a Full Code status and 31% 
of patients and 19% of surrogates were unable to con- 
clude that CPR would not be performed if the patient 
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104 patients were admitted to 2 ICUs 
in a single medical center 



35 patients were excluded: 
-21 surrogates were not 
available 

-6 patients were not available 

-4 patients refused 

-2 surrogates refused 

-2 patients did not speak English 



69 participants completed the survey 



32 patients with decision making 
capacity completed the survey 



1 



37 surrogates completed the survey 



Figure 2 Study enrollment. 



chose to have a Do Not Resuscitate code status. Two 
out of 20 internal medicine residents did not answer 
correctly the question "What do the letters CPR stand 
for?" and one out of 20 residents who had just started 
his/her training had not previously performed CPR. 

Factors associated with lower knowledge scores for pa- 
tients and surrogates include: advanced age, male sex, 
widowed or divorced marital status, and lower education 
level. Patients with lower self-perceived health literacy 
and lack of prior health care experience also had lower 
total knowledge scores. There was no observed associ- 
ation between total knowledge scores and race, prior ex- 
perience performing CPR, primary ICU service, Acute 
physiology and chronic health evaluation III (APACHE 
III) score, or admission code status order (Table 3). 

Internal consistency and test-retest reliability 

Cronbach's alpha for the total knowledge score was 
0.97, with values > 0.7 representing acceptable internal 
consistency. Test-retest reliability was performed on 36 
study participants. The correlation between pretest and 
posttest total knowledge scores was high with a Pearson 
correlation of 0.96 with a 95% confidence interval of 
0.92-0.99 (p < .001). 

Discussion 

This survey was developed to measure CPR knowledge 
in critically ill patients and their surrogate decision 
makers. The survey showed strong face and content val- 
idity, as well as internal consistency, test-retest reliabil- 
ity, and discriminative validity. The survey was easily 
administered to a cohort of ICU patients and surrogates 
by a survey administrator who read the survey verbatim. 
Initial survey results showed that patients and surrogate 
decision makers had relatively poor knowledge of CPR 
terminology, components, complications, and available 



preference options. While our results confirm prior 
studies that have shown patients' limited understanding 
of the definition of CPR and its components [3,4,10-16], 
our survey showed these results in a validated format in 
an ICU population and incorporated additional ques- 
tions to extend the assessment of knowledge of resusci- 
tation preferences (ie Full Code, Do Not Resuscitate, and 
Do Not Intubate). 

In the hospital, patient instruction regarding CPR and 
resuscitation preference options occurs primarily during 
code status discussions. These circumstances of these 
discussions-often brief, laden with medical jargon, oc- 
curring under stressful circumstances with providers at 
various levels of training-may actually contribute to 
poor knowledge among patients and their families [8]. 
Furthermore, code status discussions also occur with 
varying frequency [3-6] and contain variable content 
[17]. The impact of critical illness, age, and patients' per- 
ceived health literacy may also contributed to limited 
comprehension. Additionally, some patients may avoid 
discussing CPR with their health care providers, delaying 
complex decision making and potentially impairing 
knowledge acquisition [4]. It should be noted that code 
status discussions should not occur in isolation, and are 
part of a larger assessment of the patients' preferences, 
values, and goals of medical treatment. Discussions 
about resuscitation preferences should ideally occur as 
part of advance care planning in the outpatient setting. 

As we hypothesized, surrogate decision makers had 
somewhat higher total knowledge scores than did patients. 
Potential reasons to explain this observed difference in- 
clude, surrogates were younger, predominantly female, 
had more health care experience, and had greater per- 
ceived health and self-reported health literacy. Although 
having a family member hospitalized in the ICU has been 
associated with high rates of psychologic distress and 
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Table 1 Characteristics of participants 



Characteristic 


Patients 
(n = 32) 


Surrogates 
(n = 37) 


Physicians 
(n = 20) 


Age, years, median (IQR) 


62(50-71) 


49(41-63) 


29(27-32) 


Female gender, n (%) 


8(25) 


23(62) 


7(35) 


Non-Caucasian race, n {%) 


0(0) 


4(11) 


9(45) 


Marital status, n (%) 








Single 


2(6) 


7(20) 


1 1 (55) 


Married 


23(72) 


25(71) 


9(45) 


Widowed 


4(13) 


0(0) 


0(0) 


Divorced 


3(9) 


3(9) 


0(0) 


Education, n (%) 








Eighth grade or less 


0(0) 


1(3) 


0(0) 


High school 


7(22) 


9(24) 


0(0) 


Some college 


10(31) 


12(32) 


0(0) 


College graduate 


5(16) 


12(32) 


0(0) 


Postgraduate 


6(19) 


3(8) 


20(100) 


Unknown 


4(12) 


0(0) 


0(0) 


Religious preference, n (%) 








Christian, non-Catho ic 




I 0(44) 


UpUJ 


uauioiic 


1 rV3 1 \ 
I Up I J 


1 1 r^ 1 \ 
l I p l J 


4(zUJ 


Jewish 


U(U; 


1 

1 P) 


U(U) 


Muslim 


r\lr\\ 
U(U; 


U(U) 


1 K\ 
IP) 


\jmer 


U(U; 


3(0) 


A 1 U) 


None 


U(U) 


5(14} 


3(15) 


Self-reported hea th status, 

n (%) 








Excellent 


2(6) 


7(19) 


10(50) 


Very good 


3(9) 


1 7(46) 


9(45) 


Good 


4(13) 


1 1 (30) 


1(5) 


Fair 


11(34) 


2(5) 


0(0) 


Poor 


12(38) 


0(0) 


0(0) 


neaitn literacy, n \/o) 








Extreme 


13(41) 


1 7(46) 


14(70) 


Quite a bit 


5(16) 


1 1 (30) 


5(25) 


Somewhat 


6(19) 


4(11) 


1(5) 


A little bit 


3(9) 


1(3) 


0(0) 


Not at al 


5(16) 


4(1 1) 


0(0) 


Prior health care experience, 
n (%) 


6(19) 


14(38) 


20(100) 


Has previously performed 
CPR on somebody else, n {%) 


2(6) 


4(11) 


1 9(95) 


Has had CPR previously 
performed on themselves, 
n (%) 


2(6) 


2(5) 


0(0) 


Medical patient, n (%) 


18(56) 


14(44) 


NA 


Surgical patient, n {%) 


27(73) 


10(27) 


NA 


ICU admission APACHE III 


53(44-71) 


53(49-72) 


NA 



score, median (IQR) 



Table 1 Characteristics of participants (Continued) 



Code status on ICU 
admission, n (%) 






NA 


Full code 


29(91) 


37(100) 


NA 


DNR 


3(9) 


0(0) 


NA 


ICU ength of stay, 
median (IQR) 


2(1-3) 


3(2-9) 


NA 


Hospital length of stay, 
median (IQR) 


6(3-14) 


14(6-21) 


NA 


Surrogate relationship to 
patient, n (%) 


NA 




NA 


Spouse or partner 


NA 


15(41) 


NA 


Parent 


NA 


3(8) 


NA 


Child 


NA 


14(38) 


NA 


Sibling 


NA 


2(5) 


NA 


Other 


NA 


3(8) 


NA 



IQR, interquartile range; CPR, cardiopulmonary resuscitation; ICU, intensive care 
unit; DNR, do not resuscitate. 



burnout among surrogate decision makers [18,19] our 
survey was not designed to determine if this impacted sur- 
rogates' knowledge scores. In addition, cognitive factors 
such as emotional distress, pain, anxiety, and depression 
in ICU patients with decision making capacity may impact 
decision making about complex and sensitive issues such 
as resuscitation preferences. 

Although nearly all internal medicine resident phys- 
ician participants answered every survey question cor- 
rectly, some physicians did not know what the letters 
CPR stood for, could not name all of the components of 
CPR in the hospital, or had not previously performed 
CPR on a patient. These findings reveal that some physi- 
cians in training have a degree of unfamiliarity with 
CPR. In a system where a majority of code status discus- 
sions occur between patients and physicians in training, 
physician unfamiliarity may impact patient knowledge 
and decision making [20]. Code status discussions 
should occur with clinicians who have received sufficient 
training and experience in resuscitation decision making. 

Our study has several limitations. The survey instru- 
ment did not attempt to measure respondents' under- 
standing of CPR survival rates, which has been shown to 
be an important factor in patient and surrogate CPR de- 
cision making [6,12,13,15]. We did not control for par- 
ticipant recollection of occurrence or content of CPR 
discussions with health care providers, which may have 
impacted knowledge scores. We did not control for so- 
cioeconomic status. Patient race has been shown to 
introduce variability in ICU decision making, and our 
study participants were mostly Caucasian and entirely 
English speaking [21]. We also did not measure patient/ 
surrogate satisfaction with the survey. The survey was 
tested in a single center with a limited number of 
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Table 2 CPR knowledge scores and discriminative validity 



Question (%) 


Patients 
(n = 32) 


Surrogates 
(n = 37) 


Physicians 
(n = 20) 


P value 


What do the letters CPR 
stand for? 


41% 


57% 


90% 


.002 


What is the purpose 
of CPR? 


56 


76 


100 


.002 


When would members of 
the medical team start 
performing CPR? 


75 


84 


95 


.17 


What treatments are used 
in CPR? 










Chest compressions 


81 


92 


90 


.38 


Breathing assistance 


56 


76 


95 


.008 


Defibrillation 


23 


35 


75 


<.001 


Medications or fluids 


9 


24 


90 


<.001 


Could correctly identify 
chest compressions and 
breathing assistance as 
components of CPR 


12 


27 


85 


<.001 


What does intubation 
mean? 


37 


57 


100 


<.001 


1 A /I j- J I "1 

What does mechanical 
ventilation mean? 


34 


68 


100 


<.001 


What are some possible 
complications of CPR? 


59 


76 


100 


.004 


What do the letters "DNR" 
stand for? 


41 


59 


100 


•c.001 


What do the letters "DNI" 
stand for? 


34 


49 


100 


•c.001 


Response to full code 


63 


51 


100 


•c.001 


Response to DNR 


69 


81 


100 


.02 


What does code status 
mean? 


22 


8 


95 


<.001 


Total knowledge score, 
0-15 points (IQR) 


7(5-10) 


9(7-12) 


14.5(14-15) 


•c.001 



CPR, cardiopulmonary resuscitation; DNR, do not resuscitate; DNI, do not 
intubate; IQR interquartile range. 



participants. Additionally, it was only tested in internal 
medicine residents, and not in a larger population of phy- 
sicians at various stages in their careers. 

According to the current prevailing paradigm of patient- 
centered care, treatment decisions are ideally made using 
a shared decision-making model between patients, their 
surrogate decision makers, and their medical providers. 
Patient education regarding CPR and available CPR op- 
tions is an essential step in this shared decision making 
process. This study confirms that patients and surrogates 
have a limited understanding of CPR in the hospital and 
highlights the need to develop interventions that can im- 
prove CPR knowledge and decision making, especially 
since prior interventions such as information leaflets have 
shown limited impact [22,23] . 



Table 3 Predictors of higher knowledge scores in patients 



and surrogates 



Characteristic 


Total knowledge 
score, median (IQR) 


p value 


Age, years 




.03 


> 60 


7(5-9) 




< 60 


9(7-12) 




Sex 




.05 


Female 


9(7-12) 




Male 


7(5-10) 




Race 




.23 


Non-Caucasian race 


8(5-10) 




Caucasian 


10(8-12) 




Marital status 




.02 


Single 


10(8-13) 




Married 


8(5-10) 




Widowed 


5.5(2-6) 




PliwnrfpH 
L/l VUI LtrU 


' W o} 




Education 




.UO 


> ("fillpfip nrsHi istp 


7f5-in^ 




■C CO lege graduate 


1 n/7 1 1\ 

I U[/ — I L) 




Jtrl 1 I fcrpUI LfcrU lltrdlLII iLdLLo 




("17 


[all Ul [JUUI 


/p— I UJ 




Good or better 


9(7-12) 




How confident are you in filling out medical 
forms by yourself? (health iteracy) 




.01 


_>UI 1 IfcrWI Id L LUi 1 1 lUfcrl 1 L Ul lirbi 


7H Q\ 




Fvf rpmpk/ nr ni iitP 3 Kit f~r\nfiHpnt 
lali tru lciy ui Ljuitc a dm lui ii lutri it 


Qi7-1 1 ) 




Priior' nQ3 th r^m avr\ononro 
rllUI llfcrdILM Cdltr fcrXfJfcri Itzrl ICfcr 




-UUZ 


Yes 


] 0(7-1 3) 




1 -JO 


/p- 1 UJ 




Hpwp uni i nprfnrmprl f~PR fin 

somebody else? 




] 7 


Yes 


11(7-13) 




No 


8(5-10) 




Has CPR been performed on you? 




.03 


Yes 


5(2-7) 




No 


8(6-1 1) 




Primary ICU service 




.84 


Medical patient 


7(5-12) 




Surgical patient 


8(6-1 0) 




ICU admission APACHE III score 




.19 


> 70 


7(4-10 




< 70 


8(7-1 1) 




Code status on ICU admission 




.27 


Full code 


8(6-10 




DNR 


6(2-10) 





IQR, interquartile range; CPR, cardiopulmonary resuscitation; ICU, intensive care 
unit; DNR, do not resuscitate. 
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Conclusions 

A verbally administered survey to measure CPR know- 
ledge among critically ill patients and their surrogate de- 
cision makers showed strong face and content validity, 
as well as internal consistency, test-retest reliability, and 
discriminative validity in an ICU population. Results 
from our initial survey administration showed relatively 
poor knowledge of CPR as well as CPR preference op- 
tions among both ICU patients and their surrogates. 
This survey instrument can be used in intervention 
studies seeking to improve knowledge of CPR and CPR 
resuscitation choices in the ICU. 

Key messages 

• ICU patients and surrogates have poor 
understanding of basic resuscitation choices and 
knowledge of CPR. 

• Our validated survey can be utilized in future 
studies to measure to assess patient and surrogate 
understanding of CPR and resuscitation choices. 
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